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Amendments to the Specification: 

Please replace paragraph [17] with the following amended paragraph: 

[17] Figure 10 shows illustrative information that may fee— become part of the context 
information associated with selected content in accordance with aspects of the present 
invention. 

Please replace paragraph [33] with the following amended paragraph: 

[33] A number of program modules can be stored on the hard disk drive 170, magnetic disk 
190, optical disk 192, ROM 140 or RAM 150, including an operating system 195, one or 
more application programs 196, other program modules 197, and program data 198. A 
user can enter commands and information into the computer 100 through input devices 
such as a keyboard 101 and pointing device 102. Other input devices (not shown) may 
include a microphone, joystick, game pad, satellite dish, scanner or the like. These and 
other input devices are often connected to the processing unit 1 1 0 through a serial port 
interface 106 that is coupled to the system bus, but may be connected by other interfaces, 
such as a parallel port, game port or a universal serial bus (USB), {at this point in time , 
skree4JSB4s-sei»efmte^^ still, these 

devices may be coupled directly to the system bus 130 via an appropriate interface (not 
shown). A monitor 107 or other type of display device is also connected to the system 
bus 130 via an interface, such as a video adapter 108. In addition to the monitor, personal 
computers typically include other peripheral output devices (not shown), such as speakers 
and printers. In one embodiment, a pen digitizer 165 and accompanying pen or stylus 166 
are provided in order to digitally capture freehand input. Although a direct connection 
between the pen digitizer 165 and the serial port interface 106 is shown, in practice, the 
pen digitizer 165 may be coupled to the processing unit 110 directly, parallel port or other 
interface and the system bus 130 by any technique including wirelessly. Also, the pen 
166 may have a camera associated with it and a transceiver for wirelessly transmitting 
image information captured by the camera to an interface interacting with bus 130. 
Further, the pen may have other sensing systems in addition to or in place of the camera 
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for determining strokes of electronic ink including accelerometers, magnetometers, and 
gyroscopes. 

Please replace paragraph [41] with the following amended paragraph: 

[41] One of the benefits of a stylus-based computing system is the closeness it brings a user to 
interacting with printed paper. Instead of being separated fe*m-by a keyboard and mouse, 
a stylus-based computer permits a user to more intimately interact with a document and 
displayed content as easily as one would interact with physical paper. One may use the 
application with an electromagnetic digitizer, may use a resistive touch screen or the like. 
The application may use functionality provide with ink (strokes, properties, methods, 
events, and the like) or may rely on bit mapped images of ink encircling content. 

Please replace paragraphs [44]-[45] with the following amended paragraphs: 

[44] Figure 3 shows an example of how one may activate the content capture aspect of the 
present invention. A display on a user's computer is shown as region 301. Region 301 
includes content that a user may wish to capture. A user may locate region 302 which 
includes at least one button 303 in region 301 . Upon selection of the button 303 with 
stylus 304, the content capture aspect of the present invention may be initiated. It is 
appreciated that other techniques may be used to activate the content capture application 
including, but not limited to, a gesture of the stylus 304, tapping on a button not in region 
302, clicking of a button on stylus 304, pressing a hardware button on a_keyboard or a 
computer's case, and the like. Further, aspects of the present invention may be accessible 
through application programming interfaces called by another application. 

[45] Figure 4 shows the designation of content in accordance with an_aspect of the present 
invention. Content is displayed in region 401. As an example, Aa user wants to capture 
content in the vicinity of eente-nt -region 402. In this case, aA user may us e st y lu s 4 03 to 
encircle content in the region 402 by using stylus 403. To provide the user with an 
indication of the content as being selected, the system may display the track of stylus 403 
as path 404. Path 404 may be displayed as thick or thin, opaque ink. Alternatively, path 
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404 may be displayed as translucent ink so as to permit a user to see the content in the 
selected region 402 beneath the ink. Further, path 404 may not be displayed as a 
boundary, but rather may separate various levels of shading to distinguish selected region 
402 from on selcctcd other regions. The system may determine the selection of region 402 
based on the completion of a closed shape made by the stylus 403. Alternatively, the 
system may determine the selection based on content partially encircled by the stylus 403 
and drawing a connecting line between the stylus' current position and the position where 
the stylus was first placed on the screen. Also, other techniques of selecting content 
include rectangular selection, window selection and full screen selection. These 
alternative selection techniques may be performed by both a mouse and a pen/stylus. 
Selection feedback may be similar to the feedback described herein. 

Please replace paragraphs [47]-[48] with the following amended paragraphs: 

[47] Toolbar 501 includes a number of options that may be used with the designated content 
in se lected region 402. For instance, a user may copy designated content in selected 
region 4 02 to a clipboard upon selection of a first button 502. A user may save the 
content of region 402 by selection of button 503. A user may e-mail the content of region 
402 upon selection of button 504. The email feature permits users to easily share 
information by emailing the captured image and any annotation, or by copying it to a 
clipboard so that it can be pasted into another program. 

[48] A user may print the content of region 402 upon selection of button 505. Upon selection 
of button 506, the system may open a content selection editor where the content of 
designated region 402. Further, the system may display multiple selection regions 402 to 
a user at the same time, providing a user with the ability to compare the content of 
multiple selection regions 402 against each other. This may facilitate comparison 
shopping over the int e rn et- Internet without the need to open and maintain separate open 
windows. 
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Please replace paragraphs [50] -[51] with the following amended paragraphs: 

[50] Upon selection of button 510, the user may erase some or all of the content in region 402. 
Upon selection of button 511, the user may operate a selection tool to further select some 
or all of the content of region 402. Finally, upon selection of button 507, the tee! 
bs rtoolbar 501 and region 402 may be closed. 

[51] Figure 6 shows the processing of designated content in accordance with aspects of the 
present invention. A region 601 includes designated content 602, border 603 which 
defines the shape of content 602, and an annotation 604. The designated content with 
additional information (optional, but shown here as border 603 and annotation 604) may 
be forwarded to an email client (for instance) for handling. Here, as shown by draft email 
605, the content 602 and optional additional information may be provided in the email as 
606 or may be included as an attachment. Other actions may be performed on content 
602. For instance, the content 602 may be copied to a clipboard 607, and then forwarded 
to other applications 608-610. Alternatively, content 602 may be forwarded directly to 
other applications 60 7-609 608-610. 

Please replace paragraph [54] with the following amended paragraph: 

[54] Aspects of the present invention may be implemented as a stand-alone application. 
Alternatively, aspects of the present application may be incorporated into a shell 
providing a graphical user interface to a user. In one example, the capturing tool may be 
integrated into an internet Interngi browser. 

Please replace paragraphs [56]-[57] with the following amended paragraphs: 

[56] Figure 7 shows a process in which content is designated in step 701, context information 
is harvested in step 702, and the context information is associated with content in step 
703. All three steps may occur on the same machine within a short period of time. 
Alternatively, the various steps may be separated from each other. For instance, the 
"designate content" step 701 may be separated from the "harvest content" step 702 such 
that the content may be processed at a first location or a first time and- with t he content 
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harvesting occurring at a second location or a second time. A user may be running low on 
batteries or may be using a relatively slow processor and wish that the context harvesting 
te-be delayed until a later time. 

[57] Further, two users may invoke the process of Figure 7. A first user may designate content 
701. A second user may harvest context information 702 from the designated content and 
associate it with the designated content in step 703. For instance, the first user may 
highlight a URL while the second user may navigate to the site identified by the URL and 
harvest content from that location. Other variations are possible. The content may be 
forwarded in various forms to another user as shown in Figure 6. For instance, one may 
email the selected content with context information to another. Also, one may send the 
selected content with context information to another. The context information may be 
stored as a separate file or may be stored with the image of the selected content. For 
instance, if the selected content is transmitted as a JPEG f ormat or any file format that 
includes a comment field or fields, the context information may be parsed and transmitted 
in the comment field or fields. If the recipient has a system that is enabled to use the 
context information, this information may be extracted and provided to the user. 

Please replace paragraphs [60]-[61] with the following amended paragraphs: 

[60] Figure 10 shows various information that may become part of the context associated with 
selected content. A user selection 1001 becomes part of content 1002. Context 1003 may 
be associated (arrow 1004) by a variety of processes as described with relation to Figures 
8 and 9. Context 1003 may include the following: uniform resource locators (URLs) 1005 
of web pages or information in content 1002, file names 1006 of files captured in content 

1002, folder names 1007 of folders captured in content 1002, text in selected region 1008 
whose boundaries were determined from the user selection 1001, and recognized text 
from ink 1009 within the content 1002. 

[61] The context information may be displayed to the user in various ways. For instance, the 
context may be displayed as a property in a window or when hovering over the content 

1003. Also, to some extent, the context may be modified. For instance, a derived title of 
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the content may be taken from a URL. However, as some URLs are meaningless to users 
when the URLs include CGI script or ASP information, titles of the content may be 
modified to provide a better understanding of what is represented by the content. As an 
example, a title may be represented by a web address including 
data.asp?loc=123&sku=70012330 that attempts to look up sku number 70012330. Sku 
numbers are meaningless to the average consumer while the content of the page (e.g., a 
camcorder) has value. Accordingly, a user may edit the title to reflect a title that they can 
use to more accurately fefl-eet- irulicate t he significance of the content to them, e.g. 
"Camcorder on Sale." 

Please replace paragraphs [65]-[67] with the following amended paragraphs: 

[65] In an alternative approach, only complete characters or words may be captured. This may 
depended on the size of selection 1101. The resulting text 1106 may then be added to 
context 1105. 

[66] The capturing of text may also include the capturing of associated links to embedded 
pictures, photographs, and the like. Active content information may also be captured 
including, for instance, content and how the content has changed. Th e - ehanging - ee - nten t 
may include 

[67] Figure 12 shows designation of folders and files. Folder 1. 1201 includes three files: file 1 
1202, file 2 1203, and file 3 1204. Selection region defined by loop 1205 includes all the 
content of folder 1 1201. A rule may be established that only entire folders designated by 
a selection loop (or other process) 1205 may be included in context 1208. Also, a rule 
may be established that any part of a folder that is encompassed by a selection loop 1205 
may be included with context 1208. Here, selection loop 1205 encompasses folder 1 1201 
so under either rule, folder 1 1201 would be selected. Selection of folder 1 1201 may 
include in context 1208 the folder name and/or path. Context 1208 may or may not 
contain the files in the selected folder 1 1201. 
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Please replace paragraph [73] with the following amended paragraph: 

[73] The IAccessible interface provides a name property and a value property. These 
properties are both text strings. The contents of these strings are defined by the 
application which created the window of interest. These strings are also accessed by 
Assistive Technology products, (e.g. screen readers), and so the text will normally relate 
to the window. The system attempts to find a URI in at least one of the value and name 
properties in step 1304 . The system may first query the value field or the name field or 
use information from both. If, in step 1305, a URI is found, then the process ends in step 
1307. If not, then the system uses the parent window of the current window being 
examined as shown in step 1306. If the parent window exists in step 1306, then the 
parent window becomes the current window in step 4-307- 1308 and the system performs 
steps 1303 -1305 again. If there are no parent windows, then the system ends in step 
1307. 

Please replace paragraph [80] with the following amended paragraph: 

[80] In step 1405, the system may then use the above pointer to navigate through the text or a 
pointer assigned at a default location. The pointer may then be used to obtain details of 
the text itself. The system may navigate through the text and, for each character or word 
in the text, may determines the bounding box for the character or word. Next in step 
1405, the system compares this bounding box with the region that defines the selection. If 
the character or word is determined to lie entirely within the region, the system then looks 
up the word or character corresponding to the bounding box and includes this character or 
word with the harvested content in step 1406. If the character does not lie entirely within 
the selected region then it may be ignored. The system then repeats the process with the 
next character or word in the text. 
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